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1 The present invention is generally related to a method of coding arefacts 
reduction, in particular of a discrete decoded picture. 

Generally, picture coding/ compression standards like JPEG or MPEG are 
5 based on block-based discrete cosine" transformation (DCT) encoding. There- 
fore, a loss of quality might arise within an encoded image, such as blocking or 
ringing artefacts. 

Different methods are proposed to reduce such a loss of quality, like from H.W. 

10 Park, Y.L Lee "A Postprocessing Method For Reducing Quantization Effects And 
Low Bit-Rate Moving Picture Coding", IEEE Transactions on Circuit Systems 
For Video Technology, Vol. 9, No. 1. February 1999, pages 161-171, and by S. 
Minami, A. Zakhor "An Optimization Approach for Removing Blocking Effects 
in Tranform Coding", IEEE Transactions on Circuits and Systems for Video 

15 Technology, Vol 5, No. 2, April 1995, pages 74 to 82. 

In particular, according to the first mentioned described postprocessing 
method blocking artefacts are reduced by one-dimensional horizontal and ver- 
tical lowpass filtering and the ringing noise is reduced by two-dimensional sig- 

20 nal-adaptive filtering. Since such restoration techniques for removing blocking 
effects are described to result in unnecessary blurring of the image in the lat- 
ter mentioned paper, a new approach is proposed therein which exploits the 
correlation between the intensy values of boundary pixels of two neighbouring 
blocks! This approach is based on the theoretical and empirical observation 

25 that under mild assumptions quantization of the DCT coefficients of two neigh- 
bouring blocks increases the expected value of the mean squared difference of 
slope (MSDS) between the slope across two adjacent blocks, and the average 
between the boundary slopes of each of the two blocks. Since the amount of 
this increase is dependent upon the width of quantization intervals of the 

30 transformed coefficients among all permissible inverse quantized coefficients 
the set of DCT coefficients which reduces the expected value of this MSDS by 
an appropriate amount is most likely to decrease the blocking effect. 



US 5,442,462 shows an apparatus and a method for smoothing images appli- 
cable for adaptive spatial noise reduction, adaptive temporal noise reduction 



MULLER & HOFFMANN , - 3- 

Sony International (Europe) GmbH 52.411 27.1.1.2000 

1 and a combination thereof. It is described to use the teaching to cope with 
noise artifacts resulting from spatial and spatio-temporal image coding and 
compression methods such as block transform techniques. Further, iterated 
computation in presence of excessive noise is allowed. The adaptive smoothing 

5 technique determines a most suitable weighting for each processed pixel. 
Furthermore, also a manual input from a user is described to adapt the output 
image to the desires of the user. Finally it is described that the disclosed 
method performs the time domain smoothing after the spatial smoothing 
operation is performed. 

10 

WO 99/22509 describes an image data post-processing method for reducing 
quantization effect and an apparatus therefore. In the introductory part of the 
specification a spatio-temporal adaptive post-filtering is mentioned for low bit 
rate video signals. Further, according to the proposed method qualified 

15 semaphores are generated using the distribution of inverse quantization 
coefficients of inverse-quantized image data and a motion vector, whereafter 
the reducing of blocking artifacs is strongly or weakly performed depending on 
the generated blocking semaphore (similar for ringing). Although a temporal 
filtering is not directly described, the proposed method reduces the quanti- 

20 zation effect adaptively by using spatial frequency and temporal information. 

However, all of the above described methods inherit the disadvantage of a 
relatively high needed calculation power because of processing an entire image 
and in particular to determine a filtering characteristic in the aim to reduce 
25 coding artefacts based upon determination of an objective parameter influenc- 
ing the respective filtering. Further, the image improvement is only noticable 
by encoding with a relatively low bit rate. That means that the improvement 
topples to degradation applying the method to encode sequences with high im- 
age quality. 

3° 

Therefore, it is the object underlying the present invention to provide a further 
method to reduce coding artefacts within a discrete decoded picture which 
overcomes the above mentioned problems of the prior art methods. 

35 This object is solved by the method to reduce coding artefacts within a dis- 
crete decoded picture as denned in independent claim 1. Preferred embodi- 
ments thereof are respectively defined in the dependent claims 2 to 14. 
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1 The method to reduce coding artefacts within a discrete decoded .picture 
according to the present invention is characterized by a spatial and/or tempo- 
ral filtering with respective filter characteristics dependent on an image qual- 
ity value. 

5 - . .... . . . 

Preferrably, the image quality value is the result of the combination of meas- 
urements in spatial domain with the quantization coarseness applied to the 
neighbourhood of the observed region and a statistical function that repro- 
duces a subjective, quality perception. The result of measurements in spatial 

10 domain is a value that is very close related to the investigated artefact or deg- 
radation. For example in case of blocking artefacts, the spatial measurement 
might be a value that reproduces the discontinuity at block borders (e.g. the 
mean squared difference of slope MSDS might be used]. The function used to 
reproduce the subjective quality perception might be a picture quality rating 

15 function as described in the European Patent Application 00 121 123.4 of the 
same applicant which content is herewith included by reference into this 
specification. ' 

Therewith-, the present invention basically differs from the coding artefact 
20 reduction methods according to the prior art in that the respective filter 
characteristics are not. dependent on a parameter rating the artefacts included 
. v within the . picture as , objective as possible based on only spatial measure- 
ments, but the present invention performs spatial and/ or temporal filtering 
with respective filter characteristics dependent on a subjective biased quality 
25 .value, namely an image quality value which is gained from an overall charac- 
teristic of the image to be. filtered. As mentioned above, preferably, said image 
quality value is determined according to the applicant's European patent ap- 
. plication "Quality, Rating Function for a Discrete Decoded Picture" which 
, shows a picture quality rating function calculated on basis of information in- 
30 eluded within the picture and aiming to rate the picture quality similar to a 
subjective rating. . 

Alternatively, the picture quality of MPEG encoded sequences can be derived 
roughly from only the MQuant quantization scaling factor values. A small 
35 MQ U ant value points to a fine quantization and a large one to a coarser quan- 
tization. A fine quantization means that the picture subjectively contains a low 
level of coding artefacts that increases with the coarser quantization. This be- 
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1 haviour is exploited in the method to reduce coding artefacts according to the 
present invention. 

Alternatively or additionally to the using of coding information from the 
5 decoder to derive the image quality value, the spatial and/or temporal 
processing can also be controlled by -a corresponding parameter set by the 
user. ! : '• '" ■■•'■> 

In any case, according to the present invention artefacts are removed by 
10 improving the subjective picture quality and therefore keeping as much picture 
details as possible. This also leads to a decreased calculation power needed for 
' the filtering - and determination of the filter functions. 

According to the present invention, preferably said spatial filtering includes a 
15 deblocking' filtering wherein the deblocking filter operation decreases with an 
increasing image quality value. Therefore, according to the present invention a 
higher subjective image quality leads to a reduced deblocking filtering and 
therewith to a reduced calculation amount and results in a picture with as 
much picture details as possible. Since the derived image quality value is 
20 adapted to reflect the subjective image quality, the reduction of deblocking 
filtering does not lead to a picture which includes a high amount of visible 
blocking artefacts, although not all blocking artefacts might be optimally re- 
moved from an. objective point of view. - 

25 To decrease the deblocking filter operation, preferably an activity-dependent 
weighting function for a pixel to be filtered is chosen according to the image 
quality value, wherein the activity of both blocks to which common borders 
said pixel belongs is considered. Therefore, the deblocking filtering according 
to the present invention is not only dependent on the image quality value, but 

30 also on an activity of two blocks to which common border said deblocking 
filtering is applied. Perferably, a member of a family of curves which are all 
dependent on the activity is chosen according to image quality value. 

Further preferably, said weighting function is only applied to said pixel to be 
35 filtered if a blocking artefact is detected. This feature further reduces the 
calculation load of the processor performing the filtering, since the filtering 
itself needs a rather high calculation power whereas the determination of a 
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1 blocking artefact is a relatively easy operation. 

Still further preferably, said deblocking filtering is performed separately for 
horizontal and vertical, borders of neighbouring blocks. 
5 • . • .. ; ... . -.. 

Alternatively or additionally; to .the deblocking fUterlng, the spatial filtering 
according to the present invention comprises a deringing filtering, wherein the 
deringing filter operation decreases with an increasing image quality value. 
Similar to the case of the deblocking filtering also for the deringing filtering 
10 according to the present invention the general rule applies that the higher the 
subjective picture quality the weaker, the filtering • operation is performed to 
keep as much picture details as possible and to reduce the computational load 
needed for the filtering operations. 

15 Preferably, an image quality value-dependent deringing mask is chosen for a 
pixel to be filtered. Further, preferably, said deringing mask is only applied to 
said pixel to be filtered if said pixel belongs to a homogenous area. Therefore, 
only areas which can comprise ringing at all are subjective to the deringing 
filtering, again to reduce the needed calculation power. 

20 

Further preferably, said deringing filtering is a two-dimensional filtering taking 
, only (neighbouring pixels , of said pixel to be filtered into account which belong 
to the same region. In this case the quality value-dependent deringing mask is 
kept rather simple, since it is possible to weight the pixel to be filtered by a 

25 value dependent on the subjective image quality value and the neighbouring 
pixels with constant values. In case that the image quality value indicates a 
maximum image quality, a special deringing mask might be applied taking only 
the pixel to be filtered into account, e.g. by weighting the pixel to be filtered 
with one and all neighbouring pixels with zero, or such a deringing mask 

30. might be approximated with the setting of an appropriate image quality value- 
dependent weighting factor for the pixel to be filtered with given weighting fac- 
tors for the neighbouring pixels. 

Further, alternatively or additionally, the temporal filter operation according to 
35 the present invention decreases with an increasing image quality value. There- 
fore, similar to the case of the deblocking and deringing filtering according to 
the present invention as much picture details as possible are kept and as less 
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1 calculation power as possible is required for the temporal filtering, since also 
the temporal filter operation is reduced with an increasing subjective image 
quality value. -Similar to both other filtering* operations according to the 
present invention, the objective necessary temporal filter operation which 

5 would be performed according to the prior art is not performed according to 
the present invention in case the image quality value which is determined 
Under subjective considerations 1 indicates' that ' themporal filtering Is" not 
necessary. ' '' 

10 Further preferably, the temporal filter operation is realized with a blending 
filter -applied to an entire frame which determines a new frame as a weighted 
- sum bf a predicted frame and an actual frame, which weighting is dependent 
on said image quality value and a difference of the actual frame with the 
predicted frame. Further preferably, said predicted frame is determined on 

15 basis of a motion compensation of a previously determined frame. Therewith, 
progressive or interlaced mode is considered as well as the motion included in 
the picture to be filtered. Similar to the case of the deblocking and deringing 
filtering according to the present invention also the temporal filtering keeps as 
much picture details as possible, i.e. minimizes the required filter operations. 



According to the method to reduce coding artefacts of the present invention 
the " image quality value is preferably' determined based on a quantization 
scaling factor used for encoding the picture. Since a small quantization scaling 
factor value points to a fine quantization and a large one to a coarser quanti- 
25 zation it is observed that the subjective image quality corresponds to the used 
quantization scaling factor. Further, the quantization scaling factor can easily 
be derived during decoding of the picture so that no additional information 
resulting from encoding of the picture is necessary. 

30 Alternatively or additionally, said image quality value can also be determined • 
based on a user selection. In this case the user can e.g. adapt the filtering to a 
current reception quality of a tuner device while watching a received movie di- 
rectly according to his/her judgement of the image quality. 

35 Further alternatively or additionally, the image quality value might be derived 
as disclosed in the applicant's parallel application "Quality Rating Function for 
a Discrete Decoded Picture". 



20 




27-11-2000 



MULLER & HOFFMANN 

- Sony International (Europe) GmbH 



52.411 



- 8 - 
27.11.2000 



1 Therewith, in any case the reducing of coding artefacts according to the 
present invention is dependent on an at least approximated subjective overall 

■ impression of the picure. 

5 According to the present invention said discrete encoding/decoding of the 
• picture is based on a discrete cosine transformation arid further preferably on 
a MPEG coding scheme. - 

Therefore, the present invention exploits the behaviour that a high subjective 
10 image quality value indicates a low level of coding artefacts and a low sub- 
jective image quality value indicates a high level of coding artefacts. Therefore, 
the subjective image quality value is used to choose a filter from a set of filters 
with several characteristics. The chosen filter is applied in the relevant regions 
for the type . of artefacts, e.gJ at block borders to process in case of blocking, or 
15 inside the block to process ringing, or at every pixel position between two pic- 
tures in case of teiriporal filtering. The method according to the present inven- 
tion enables to pass frames without filtering that have been encoded with high 
quality and to smooth frames that have been encoded with poor quality. The 
degree of smoothing is controlled by the image quality value. 

20 

Further; additional blurring is preferably avoided, since the image content is 
analyzed and areas with and without artefacts are separated. Therefore, in 
case of blocking the mean value and the acitivity of the block is preferrably 
analyzed, in case of ringing an edge detection might be performed and at least 
25 motion compensation is advantageously used for temporal filtering. 

■ Still further; according to the present invention a quantization scaling factor 
which can be derived from the decoded image sequence might be used to re- 
flect the subjective image quality value, since a small quantization factor value 

30, points to a fine quantization and a large one to a coarser quantization, wherein 
a fine quantization means that- the picture contains a low level of coding arte- 
facts that increases with coarser quantization. In case that no quantization 
scaling factor values are -available or additionally thereto the image quality 
value can be manually set by the viewer. 

35 

Further features and advantages of the present invention are elucidated by the 
following description of a preferred embodiment thereof taken in conjunction 
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1 with the accompanying drawings, wherein 

Fig. 1 shows an example of a system .according to the present 

invention to reduce coding artefacts; 
5 . - •.; , . 

Fig. 2 ..shows ,the subjective, image, quality versus a quantization 

scaling factor value; 

Fig. 3 shows the preparation of a mask to apply deblocking filtering; 

10 ..... 

Fig. 4 ... shows examples for filter characteristics for a. one-dimensional 

. deblocking filtering; ....... 

Fig. 5 shows the preparation of a mask to apply deringing filtering; 

Fig. 6 , shows an example of two-dimensional deringing filters; 

Fig. .7 elucidates the principles of the -deringing filtering according to 

the present invention; 

Fig. 8 shows an embodiment of the temporal filtering according to the 

■■•< present invention; and .- . - •■■ _ -■ - ■ ■-. .- 

Fig. 9 shows an example for blending filter characteristics of a 

blending filter shown in Fig. 8. 

Fig. 1 shows a preferred embodiment of a system to- reduce coding artefacts in 
conformity with the method to reduce, coding, artefacts within a discrete 
decoded picture according to the present invention. An incoming picture signal 
30 P n first undergoes a deblocking filtering 1 with a following deringing filtering 1 
in the spatial domain before it is filtered in the temporal domain by a motion 
compensation temporal .filter. 6 which outputs the coding artefacts reduced 
picture signal pTF n . The deblocking filter 1 and the deringing filter 2 have 
both access to a filter bank 5 to perform the respective necessary filter 
35 operations. To decide which parts of the picture will be subjected to the 
deblocking filtering 1 and the deringing filtering 2 a respective analysis is 
performed as described above. Therefore, a blocking analysis block 3 receives 
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1 the incoming picture signal P n to output a control signal Mb for the 
deblocking filter 1 and a ringing analysis block 4 receives the output signal of 
the deblocking filter 1 to output a control signal Mr for the deringing filter 2 
which outputs the spatial filtered picture signal pSF n to the temporal domain. 

5 "The blocking analysis block 3 arid ; the ringing analysis block 4 respectively re- 
ceive further control parameters, such as a Frame/Field mode and the image 
-quality value Q. The Frame/Field mode parameter enables to apply the filter- 
ing operation based on a frame -(progressive picture format) or field (interlaced 
picture format) mode,- since e.g. J a frame-based filter applied to a field (inter- 
10 -laced) sequence results in a blurring distortion in the moving regions. 

These control parameters r are - adjusted by a postprocessing control module 8 
which receives coding information e.g. by a not shown MPEG decoder and/or a 
user control, i.e. a picture quality value provided by the user. The post- 
15 processing ' control : module 8 also supplies control parameters to the temporal 
' domain, namely the parameters to set the temporal filtering within the motion 
~ compensation temporal filter 6 which receives the spatial filtered picture signal 
pSF n and outputs the coding artefacts reduced discrete decoded picture signal 
pTF n . To determine this coding artefacts reduced discrete decoded picture 
20 signal pTF n the motion compensation temporal filter 6 also receives , the 
preceding coding artefacts reduced discrete decoded picture signal pTF n _ i , i.e. 
the preceding frame of this picture signal, which is obtained "by delaying the 
preceding output signal of the motion compensation temporal filter 6 by one 
frame with a frame memory 7. 

25 

To perform the filter operations first an image quality value Q has to be 
determined. Fig. 2 shows a dependency of the quality value Q from the quanti- 
zation scaling factor values MQ ua nt f° r MPEG decoding. This curve can be 
expressed by an exponential function with a negative exponent which indicates 

30 a" maximum image quality for a scaling factor Mg ua nt = 1 and a minimum 
image quality for a scaling factor Mg ua nt — 112. Of course, these values of the 
scaling factor- which are adapted to MPEG coding and decoding represent only 
relative values. Further, as mentioned above, the image quality value Q is 
preferably derived according to the applicant's parallel European patent appli- 

35 cation "Quality Rating Function for a Discrete Decoded Picture". 

In the following the deblocking filter operation is described in respect to Figs. 
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1 . 3 and 4 before the deringing filter operation is described in respect to Figs. 5 
to 7 and the temporal filtering is described in respect to Figs. 8 and 9. 

Fig.. 3 shows the preparation of a. filter mask to apply. the deblocking filtering, 
5 in. particular a. frame preprocessing block 3a and a , blocking mask selection 
block 3b included^ within, the blocking , analysis block 3 shown in Fig. 1. The 
frame preprocessing block. 3a receives an incoming frame, i.e. the incoming 
picture signal . P n , and ;j measures the. activity- A within all discrete decoded 
.. blocks, i.e. 8x8 blocks. in case of MPEG coding. The measurement results in re- 

10 gions with very low and regions with higher activity A. Further, the frame pre- 
processing block 3a calculates a mean value M of all these blocks. The activity 
A. and the mean value M of all 8x8 blocks are supplied to the blocking mask 
selection block 3b which also -receives the image quality value Q supplied by 
. the .postprocessing control module 8 which receives the quantization, scaling 

15. factor value Mg uan t : The blocking- mask selection block 3b selects, a filter 
function Fb [Q] from the filter functions shown in Fig. 4 which are basically a 
family of lowpass filter functions with different cut-off frequencies so that for a 
higher image, quality value Q a. wider pass, band is available. A good practical 
rule is to define ,the filter functions between half resolution (f/Fjj=0,5) and 

20 passed through (no filtering). An acceptable performance is achieved with a set 
of 4. filter, .characteristics T . The filter mask generation for vertical borders is ba- 
sically performed, according, to the following decision: 

If | M[m][n]-Mfm-l][n) | >Tm then vertical object border instead of 
25 blocking 

else ■ •. . 

If Alm][n]<TA and A[m-l][n]<TA - then filter = Fb[Q) 
otherwise filter = FbIQ+1] 

30 wherein [m] defines the horizontal index from the current block, [n] defines 
the vertical index from the current block, (m-1] defines the horizontal. index 
from the left block of the current block, [n-1] defines the vertical index from 
the upper block of the current block, Tm defines a threshold value to differen- 
tiate an object border from a synthetic border (blocking) based on the transi- 

35 tton of mean values measured for two neighbour blocks, and Ta defines a 
threshold value to choose the deblocking filter intensity based on the activity 
measurement for two neighbour blocks. 
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1. For horizontal borders the same procedures are applied as described above for 
vertical borders, however, with vertical indices. This means: 

If |M[m][n]-M[m][n-l]|>TM then horizontal object border instead of 
5 blocking - . ,, . 

else 

If AlmJInJ^A and A(m][n-1]<TA : then filter = FbIQ] ! 
otherwise filter = Fb[Q+1] . 

10 The filter mask for deblocking contains, the information about the filter inten- 
sity coupled to the direction of filtering (horizontal/vertical blocking). 

The deblocking filtering 1 shown in Fig. 1 is then performed for all pixels of the 1 
picture according to the filter mask. . 

15 

Fig. 5 shows the preparation of a mask to apply the deringing filtering, namely 
an edge detection block 4a and a ringing, mask selection block 4b included 
within the ringing analysis block 4 shown in Fig. 1. The edge detection block > 
4a receives an incoming frame, i.e. a frame output. from the deblocking filter 1, 
20 to differentiate edges from homogenous areas. The result of this edge detection 
is supplied to the ringing mask selection block 4b which also receives the im- 
age quality value Q as used for the choosing of the blocking mask. The ringing 
mask selection block 4b then outputs a deringing mask MaskR according to 
which a filter is chosen. 

25 

Fig. 6 shows an example of two-dimensional filters to be chosen according to 
the output of the ringing mask selection block 4b. To apply the deringing filter 
the Quality range is divided in a practical number of quality areas, in this case 
. e.g. 4 areas QA m i n . QAiow> QAhigh. QA m ax> as shown in Fig. 2. For Q = 
30 9A m in. QAiow. QAhigh a filter mask is chosen which consists of 3x3 pixel 
weighting coefficients to be applied to the pixels around a pixel to be filtered 
and the pixel to be filtered itself. The pixel to be filtered itself is weighted with 
a value W which is dependent on Q, e.g. 
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35 r 4 for QA min 

W[Q] = "18 for QAiow 
16 for QAhigh 
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1 The pixels horizontally and vertically adjacent to the pixel to be filtered are 
weighted with the constant value 2 and the pixels diagonally adjacent to the 
pixel to be filtered are weighted with the constant value 1. For Q = QA m ax the 
pixel to be filtered is weighted with the constant value 1 and surrounding pix- 

5 els are weighted with the constant value 0. 

The so chosen filter mask is then applied according to the filtering operation 
elucidated in Fig. 7. In case the top left pixel of the 3x3 pixel block centered 
around the pixel to be filtered is labelled with f-i,-i, the top pixel fo,-l. the 
10 top right pixel is labelled with fi,-i-, the left' 'pixel is labelled with f-i,o. the 
pixel to be filtered, i.e. the center pixel is labelled with fo,0; the right pixel is 
labelled with fi,o> the bottom left pixel is labelled with f-i,i, the bottom pixel 
with fo,l. and the bottom right pixel with fi.'l- The following function deter- 
mines the pixel value of the filtered pixel: 

15 

' X X Plp+i][l+jI-/[il[j]-S R 
j=-l i=-l 

P neW [ P ][l] = : : — 

20. ■■' 11 

XX /[i][j]-8R 

.- " • j=-l i=-l- 

with: 




if P[i][j] and P[0][0] in same region 
otherwise ' 



wherein [p] defines the absolute horizontal position in the picture of the proc- 
30 essed pixel, [1] defines the absolute vertical position in the picture of the proc- 
essed pixel, [i] defines the horizontal offset to the neighbour pixel, e.g. i=-l 
means left pixel position of current pixel, (j] defines the vertical offset to the 
neighbour pixel, e.g. j=-l means upper pixel position of current pixel, P defines 
the pixel value, and / defines a filter coefficient. 

35 

Therefore, 5r defines that only neighbour pixels are contributing to the filter- 
ing of a pixel which belong to the same region or object as the pixel to be fil- 
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.1 tered.This scenario is shown for two examples in Fig. 7 which shows a field of 
7x7 pixels divided into two objects, namely a first object (Object .1) occupying 
18 pixels in the upper right corner and a second object (Object 2) occupying 
ther rest of the field. . , - , - 

5 • . - 

. Fig- 3 shows the motion compensation temporal filter 6 in more detail. This 
motion compensation filter. 6 basically, comprises two units, namely a motion 
estimation & compensation block 6a and a blending filter which comprises a 
blending characteristic 6c, a first adder 6d, a first multiplier 6e, a second mul- 

10 tiplier 6f and a third multiplier 6g. The motion estimation compensation block 
6a receives the spatially filtered picture signal P^ F n from the deringing filter 2 
and the previous coding artefacts reduced discrete decoded picture signal 
P^n-l from the frame memory . 7. Based thereon, it performs a motion com- 
pensation to predict the actual frame from the previous one. Thereto, the mo- 

15 tion estimation & compensation block 6a additionally receives a signal Mode 
indicating a motion estimation/motion compensation mode, i.e. a signal indi- 
cating a progressive or interlaced mode. The predicted frame is supplied as 
subtrahent to a third adder 6b which receives the actual frame P SF n output 
from the deringing filter 2 as minuent to build the frame difference A between 

20 the actual and predicted frame. This frame difference A is input to select the 
belending filter characteristic which is also dependent on the image quality 
value Q. 

Fig. 9 shows an example for blending filter characteristics according to which 
25 a blending parameter a is determined. Basically, according to the image quality 
value Q a value A[Q] is determined at which a equals to 1 and below which oc 
linearly increases from a = 0 at A = 0 up to a = 1 at A = A[Q], with the general 
rule that the higher the value Q the lower the value A[Q], i.e. the lower the pic- 
ture quality the stronger the filtering. 

30 

The determined blending value a is supplied as subtrahent to a first adder 6d 
which receives the constant value 1 as minuent. The so calculated result 1-oc is 
supplied to the second multiplier 6f which receives the predicted frame output 
from the motion estimation & motion compensation block 6a. Further, the 
35 blending value a is supplied to the first multiplier 6e which also receives the 
actual frame P^ F n output from the deringing filter 2 to output the product 
thereof to the second adder 6g which adds the product of 1-a and the pre- 



mm® 



MOLLER & HOFFMANN • ' ' -15- 

SonyInternattonal 0E*m>pe) GmbH' 52.411 27.11.2000 



1 dieted frame P ■ n output from the first multiplier 6f thereto to output the 

TIT 

coding artefacts removed discrete decoded picture P -n 

Of course, as is apparent from the foregoing description the order of deblock- 
5 ing, deringing and temporal filtering is not limited to the shown embodiment, 
but these filtering operations can have ah arbitrary 1 order. However, the order 
first spatial processing and then afterwards ' temporal processing is recom- 
•' mended, because ME (Motion Estimation) s and" MG (Motion Compensation) op- 
erations are' sensible to any kind of noise: In this case, blocking as well as 
10 ringing noise will have influence -in the performance of the temporal filtering. 
For this reason , if temporal filtering is implemented then it should operate af- 
ter the spatial filtering to exploit the effect in a more optimal way.' The order 
for the spatial processing modules (deblocking, deringing) is hot restricted. 

15 . \ , . • .. '•• • . . • • ,.. • . 
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EPO - Munich 
Claims 22 

2 7. Nov. 2000 

1 1. Method to reduce coding artefacts within a discrete decoded picture, 
characterized by a spatial and/ or temporal filtering with respective filter 
characteristics dependent on an image quality value (Q). 

5 2. Method according to claim 1, characterized in that said spatial filtering 
includes a deblocking filtering, wherein the deblocking filter operation de- 
creases with an increasing image quality value (Q). 

3. Method according to claim 2, characterized in that said deblocking fil- 
10 tering chooses an activity-dependent weighting function for a pixel to be fil- 
tered according to a image quality value (Q), wherein the activity of both 
blocks to which common border said pixel belongs is considered. 

4. Method according to claim 3, characterized in that said weighting func- 
15 tion is only applied to said pixel to be filtered if a blocking artefact is detected. 

5. Method according to anyone of claims 2 to 4, characterized in that said 
deblocking filtering is performed seperately for horizontal and vertical borders 
of neighbouring blocks. 

20 

6. Method according to anyone of the preceding claims, characterized in 
that said spatial filtering includes a deringing filtering, wherein the deringing 
filter operation decreases with an increasing image quality value (Q). 

25 7. Method according to claim 6, characterized in that said deringing fil- 
tering chooses a image quality value (Q) dependent deringing mask for a pixel 
to be filtered. 

8. Method according to claim 7, characterized in that said deringing mask 
30 is only applied to said pixel to be filtered if said pixel belongs to a homogene- 
ous area. 

9. Method according to anyone of claims 6 to 8, characterized in that said 
deringing filtering is a two dimensional filtering taking only neighbouring pix- 
els of said pixel to be filtered into accont which belong to a same region. 

t 27M 1 -20.00" 
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1 10. Method according to anyone of the preceding claims, characterized in 
that the temporal filter operation decreases with an increasing image quality 
value (Q). 

5 11. Method according to claim 10, characterized in that the temporal filter 
; 'operation is realized ..with a blending filter applied to an entire frame which de- 
termines a new frame as a weighted sum of a predicted frame and an actual 
frame, which weighting is dependent on said image quality value (Q) and a dif- 
ference of the actual frame with the predicted .frame. 

io -/•••• • • .. . • . . 

12. Method according to claim 11, characterized in that said predicted 
frame is determined on basis of a motion compensation of a previously deter- 
mined new frame. 

15 13. Method according to anyone of the preceding claims, characterized in 
that said image quality value (Q) is determined based on a quantization scal- 
ing factor (MQ U ant) used for encoding the picture. 

14. Method according to anyone of the preceding claims, characterized in 
20 that said image quality value (Q) is determined based on a user selection. 

15. Method according to anyone of the preceding claims, characterized in 
that said discrete encoding/decoding of the picture is based on a dicrete co- 
sine transform. 

25 

16. Method according to anyone of the preceding claims, characterized in 
that said discrete encoding/ decodeing of the picture is based on a MPEG cod- 
ing scheme. 

30 



35 
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Abstract 



METHOD OF CODING ARTEFACTS REDUCTION 



EPO - Munich 
22 

2 7. Nov. 2000 



A method to reduce coding artefacts' within a 'discrete decoded picture includes 
a spatial and/Or temporal filtering with.; respective: filter characteristics de- 
pendent on an image quality value (Q).. Preferrably, said spatial filtering in- 
cludes a deblocking filtering, wherein the deblocking filter operation decreases 
with an increasing image quality value (Q) and /or said deblocking filtering 
chooses a image quality value (Q) dependent weighting function for a pixel to 
be filtered according to an activity of both blocks to which common border said 
pixel belongs. 



• • (Fig. 1) 
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